Building “Stuff”?

Charles F. Vardeman II

Center for Research Computing, University of Notre Dame

2023-09-05

Building Stuff?

Building Agents based on Large Language Models!

You are here ⬇️

What Kind of LLM Agents are we trying to build?

  • Conversational Agents
  • vs. Cognitive Autonomous Agents
  • vs. Agents tuned for a Data Processing Task

We will focus on Conversational Agents…

The Best Advice we can Give

Andrej Karpathy, “State of GPT” | BRK216HFS, Microsoft Build, 2023. https://www.youtube.com/watch?v=bZQun8Y4L2A.

Andrej Karpathy, “State of GPT” | BRK216HFS, Microsoft Build, 2023. https://www.youtube.com/watch?v=bZQun8Y4L2A.

Caveat: You are at the Edge of Research and Practice!

We want Large Language Models to be Factual!

  • “Fine Tuning”
  • Retrieval Augmented Generation (RAG)

We want Large Language Models to be Factual!

  • Fine-Tuning: augment the behavior of the model
  • Retrieval: introduce new knowledge to the model